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Abstract 

Network Utility Maximization is often applied for the cross-layer design of wireless networks 
considering known wireless channels. However, realistic wireless channel capacities are stochastic 
bearing time-varying statistics, necessitating the redesign and solution of NUM problems to capture 
such effects. Based on NUM theory we develop a framework for scheduling, routing, congestion and 
power control in wireless multihop networks that considers stochastic Long or Short Term Fading 
wireless channels. Specifically, the wireless channel is modeled via stochastic differential equations 
alleviating several assumptions that exist in state-of-the-art channel modeling within the NUM framework 
such as the finite number of states or the stationarity. Our consideration of wireless channel modeling 
leads to a NUM problem formulation that accommodates non-convex and time-varying utilities. We 
consider both cases of non orthogonal and orthogonal access of users to the medium. In the first case, 
scheduling is performed via power control, while the latter separates scheduling and power control and 
the role of power control is to further increase users’ optimal utility by exploiting random reductions 
of the stochastic channel power loss while also considering energy efficiency. Finally, numerical results 
evaluate the performance and operation of the proposed approach and study the impact of several 
involved parameters on convergence. 


Index Terms 
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Wireless multihop networks; Network Utility Maximization; Stochastic wireless channels; Non 
convex utilities; Time-varying utilities; Non stationarity; Transient phenomena; Long Term Fading; 
Short Term Fading; 


1. Introduction 

Network Utility Maximization (NUM) is a very popular tool in the eommunieations research 
community, for cross-layer design and optimization of wireless networks. Typieally, a utility 
function is assigned to eaeh network flow (souree-destination pair), and the sum of all utilities 
over the network is maximized, subjeet to network stability eonstraints. Most approaehes in 
literature applying NUM, consider ideal or stationary and ergodic wireless channels. However, 
under realistie eonditions, fading oeeurring in wireless ehannels hampers the performanee in 
wireless eommunieations, leading to stoehastie, i.e. time and spaee varying, random (thus un¬ 
known), wireless link eapacities possibly bearing time-varying statisties. Therefore, it becomes 
neeessary to reformulate/redesign and solve the basie NUM problem for incorporating realistic 
stochastic wireless ehannel conditions by addressing non-stationarity issues, and also transient 
phenomena oeeurring when the network operates for a finite time interval. 

This paper aims at treating this problem by proposing a novel optimization framework for 
joint congestion eontrol, routing, scheduling and power control based on NUM, under stoehastie 
possibly non-stationary Long Term Fading (LTF) or Short Term Fading (STF) wireless ehannels. 
Congestion eontrol determines the optimal sourees’ data production rates, routing determines 
the optimal routes of the flows within the network, while the set of transmitting links and their 
corresponding transmission powers are ehosen based on seheduling and power control. The 
proposed optimization framework refers to a finite network operation and it is developed for 
two oases, where the first one deals with non-orthogonal aceess to the wireless medium and 
the second deals with orthogonal aooess to the wireless medium. In the first ease, seheduling 
is performed via power eontrol, while in the latter ease, seheduling and power eontrol are 
separated. On the one hand, non-orthogonal aooess leads to a very hard to solve cross terminal 
power oontrol/soheduling problem in the physical layer. On the other hand, orthogonal aceess 
to the medium allows for more efficient and distributed power control in the physical layer, 
although introduoing the need of the NP-hard oomputation of all the independent sets of the 
network graph for seheduling. Importantly, in the ease of orthogonal aooess, the role of power 
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control is to further boost link capacity and consequently source rates by exploiting good channel 
states and to save energy when the channel state is destructive for the transmitted signal. 

The structure of the rest of the paper is as follows. Section |I^ presents the related literature 
while summarizing the basic contributions of this paper. Then, Section describes the consid¬ 
ered STF and LTF channel models derived with the use of stochastic differential equations, while 
Section presents the considered system model. Sections |V] and VI focus on the analysis and 
solution of the proposed optimization framework in the cases of non-orthogonal and orthogonal 
access to the wireless medium respectively. Finally, in Section [VTII numerical results are presented 
to evaluate the proposed approach and Section |VIII| concludes the paper. 


II. Related Work & Contributions 

Several works exist in the literature targeting at incorporating the stochastic wireless channels 
in the NUM problem’s formulation and solution. In [[T|, the channel quality is expressed via 
the SIR (Signal-to-Interference-Ratio), since the latter is affected by interference due to parallel 
transmissions and LTF. It is assumed that the LTF parameters are deterministic and slowly 
varying, allowing for the algorithms which perform joint congestion and power control to 
converge in the meantime of their change. In [|2]|, [(31, the case of composite fading (LTF 
and STF) is examined, considering channel conditions that vary faster than the algorithm’s 
convergence, via the use of outage-probabilities in the NUM problem formulation. In [l2ll, S, 
STF follows Rayleigh and Nakagami distributions respectively, where however the statistics of 
the distributions remain invariant. A different approach is followed in [|4||, [15]|, where NUM is 
extended to Wireless NUM (WNUM), with random channel conditions. WNUM leads to policies 
for controlling the network by responding optimally to the change of the channel state, based 
on random samples without a priori knowledge of the wireless channels’ statistics. Although the 
statistics of the channel may be unknown, the latter is considered as stationary and ergodic. 

In the sequel, in NUM is employed to perform, joint congestion control, power control, 
routing and scheduling assuming that the channel fading process is stationary and ergodic. Simi¬ 
larly in llTl, [[SI, joint congestion control, routing and scheduling is performed in the framework of 
NUM while assuming that there is a finite number of channel states. In these works, the network 
functions in time slots, where during each time slot the channel state remains stable and changes 
randomly and independently on the boundary of time slots. Finally, in 0 the convergence of 
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primal-dual algorithms for solving NUM is studied under wireless fading channels with time- 
varying parameters (and thus statistics). Time-varying statistics of wireless channels lead to 
time-varying optimal solutions of the NUM problem necessitating the study of how well the 
solution algorithms track the changes in the optimal values. However, it is assumed that the 
channel fading parameters vary following a Finite State Markov Chain. 

In a nutshell, in the existing body of research work in literature, the wireless channel modeling 
in the framework of NUM is characterized by one or combinations of the following assumptions: 
(a) The channel process is stationary and ergodic. (b) The statistics of the wireless channel are 
fixed in time (and known), or vary at slower rate than the one of the network control algorithms’ 
convergence, (c) The statistics of the channel change according to a Finite State Markov Chain. 
All previous approaches are not capable of capturing and tracking complex time and space 
variations in the propagation environment of realistic systems [fTOll . In IfTOl . wireless channel 
models for both LTF and STF are introduced based on Stochastic Differential Equations (SDEs) 
mil in order to capture higher order dynamics of the wireless channel. In this case the wireless 
channel is modeled via stochastic processes which may have time-varying statistics. By means 
of SDEs, it is possible to express an ETE or an STE channel capturing both space and time 
variations [fTOll . [fT^ . as it will be described in detail in Section [Til 


In our paper, the NUM problem is reformulated and solved using the SDE model to capture 
the wireless channel state. Emphasis is placed on ETE especially for demonstration purposes. 
Due to the possible non-stationarity of the wireless channel we cannot formulate the NUM 
problem based on the stationary mean values of the involved optimization variables (e.g. (Si, 
fTl . IfTSlI l. On the contrary we will adopt the stochastic optimal control problem’s formulation 
||T4| based on expected values over time integrals, thus also allowing for the consideration of a 
finite time duration of the network’s operation. In [fTSlI . we proposed a preliminary version of 
this approach focused on congestion and power control in the case of orthogonal access to the 
wireless medium. The basic contributions of this paper can be summarized as: 

• We develop a framework for the cross-layer design and control of the operation of wireless 
multihop networks, i.e. for congestion and power control, routing and scheduling, over 
wireless channels (ETE or STE) that are stochastic but not necessarily stationary. 

• The proposed problem formulation adopts a (more realistic) finite duration of the network’s 
operation (e.g. corresponding to the case of finite battery levels of the wireless nodes or of 
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finite flows) where the wireless ehannel may still operate in a transient state, even though 
there may exist a limiting stationary distribution. The extension to an infinite duration of 
the network’s operation is diseussed. 

• Utilities are not neeessarily eonvex funetions but adopt a more general form (more speeif- 
ieally a eontinuous differentiable one), eontrary to the related papers in literature (e.g. 
[|6l , [|7l , [flBlI l that assume eonvex utility forms. This faet is important sinee it allows for 
addressing the ease of real time trafiie modeled, for example, by sigmoidal utilities [[T^ . 
Zero duality gap is analytieally proven in this ease of general utilities, following a teehnique 
that leverages from the wireless ehannels’ eontinuous stoehastie modeling. 

• The proposed problem formulation (expeeted values over time integrals) allows for the 
adoption of time-varying utility funetions. This serves the purpose of evolving users’ pref- 
erenees/needs and is also aligned with the finite network duration, i.e. nodes may desire to 
produee signifieantly less data elose to the end of the network operation. To the best of our 
knowledge, this faet has not been addressed in the literature. 

• Power eontrol is shown to further boost link eapaeity and thus souree rates by exploiting 
good ehannel eonditions while saving energy in ease of destruetive ehannel eonditions. 

• Finally, we prove an interesting theorem in the ease of LTF, elueidating a basie advantage 
with respeet to the optimal users’ utilities when exploiting the random ehannel fluetuations, 
eompared to the eonventional NUM problem formulation (e.g. [(71, [[T71 ). Speeifieally, it is 
proven that, eontrary to what is possibly expeeted, a higher value of the diffusion ooeffieient 
of the wireless ehannels’ power loss leads to higher optimal sum of users’ utilities, faet 
that eannot be eaptured by the eonventional NUM modeling approaeh. We also show via 
numerieal evaluations that a higher diffusion ooeffieient aehieves simultaneously a redueed 
power eonsumption leading to energy effieienoy. This result emphasizes the importanee of 
utilizing a more realistio power loss model suoh as the one of an SDE, as opposed to the 
mean power loss model used in the eonventional NUM problem formulation. 

III. Background on Wireless Channel Modeling via SDKs 

The objective of this section is to briefly describe the SDE-based LTF and STF channel models, 
developed in the literature, and their assumptions, upon which, the optimization problems of the 
following sections will be formulated and solved. 
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A. Long Term Fading (LTF) 

LTF consists of path loss and shadowing [fTTl . Path loss is due to the dissipation of the 
transmitted power and the effeets of the propagation ehannel, while shadowing is eaused by 
obstaeles between the transmitter and the reeeiver. LTF depends on the geographical area and 
oeeurs in sparsely populated or suburban areas. Before deseribing the dynamie in time LTF 
model for the wireless ehannels m, we reeall the eonventional LTF model, where the power 
loss PL along a given link (i,j) between nodes i and j in Euelidean distanee dij, is given [fTTl : 

PL(dij)[dB] = PLido)[dB] + lOrlog(^) + Z, d,j > do, (1) 

do 

where 7 is the power loss exponent and depends on the wireless propagation medium, do is the 
referenee distanee, PL{do) is the expeeted power loss on the referenee distanee, and Z ~ 
is a gaussian random variable with zero mean and varianee cr^, used to model any uncertainty in 
the propagation environment. Note that the statisties (mean (denoted as PL{dij)) and varianee) 
of the eonventional LTF model are invariant in time. 

In the following, we describe the extension of the LTF model to dynamically changing 
conditions in time, as it is developed in IfTOll . Speeifieally, the random variable, PL{dij)[dB], 
of Eq. 0 , beeomes a stoehastie proeess denoted as {Xij{t)}t>tQ ([dB]), where t represents time. 
Time dependenee is used to eapture time variations of the propagation environment due to e.g. 
movement of objeets and seatterers in the area surrounding the network. In a similar spirit with 
Eq. Q, {Xij{t)]t>tQ, represents the power lost by the signal during a transmission from i to j at 
a particular distance dij. Although, {Xij(t)}t>tQ depends on the distance dij, we do not explieitly 
model this dependenee as the network eonsidered is statie. 

In m, {Xij(t)}t>tQ, V(/,y), are modeled as solutions of mean reverting linear SDEs, given as: 

dXijit) = /3,jit){yij{t) - Xij{t))dt + 6,jit)dW,jit), X,j{to) - N(PLid,j)[dB ]; (2) 

where {Wij(t)}t>tQ, are independent standard Brownian motions defined over a filtered 

probability spaee (Q,!F,{!Ff}/>fo,P) and eaeh one being independent of the eorresponding Xij{to). 
{Tt}t>tQ is the filtration produeed by Xij(to), and the Brownian motions themselves. Eor 

each yijit) is the power loss level Xij{t) is attracted to, Pijit) is the positive speed of this 
adjustment and finally, 6ij{t) is the diffusion eoeffieient of the SDE, determining the “noise” of 
the ehannel. The parameters /3ij{t),yij{t),6ij(t), V(z,y), are assumed to be deterministie and ean 



7 


be estimated directly from signal measurements following the approaches in [[2^ . [|T^ . [|T^ . 


which can be implemented online, i.e. while receiving the signal measurements. The existence 

n ^ 

of a strong solution to the SDE (2) is satisfied if the relation ^ \pii{t)\yij{t)\ + 5^^.{t)^dt < oo,\/(ij) 
holds IfTTI . The time dependent attenuation coefficient (in squared magnitude) equals to: aij(t) = 
= gKXijit)^ K = In IfTOl . it is shown that when all the parameters of the 

SDE Q are time independent, its solution tends to the conventional ETE model (Eq. Q) as 
t ^ oo (which is stationary). In general when the parameters of the SDE Q change with time, 
Xij(t) is gaussian with time-varying statistics and a stationary distribution may not exist. 


B. Short Term Fading (STF) 

In a similar spirit as ETE, in [fT2]l . ITT^ . IITOl a stochastic model for STE wireless channels has 
been developed, alleviating the assumption of stationarity. This kind of signal fading is due to 
the constructive and destructive addition of multipath components [fTTl created from reflections, 
diffractions and scattering and usually occurring in densely built-up areas. The statistics of the 
STE models usually applied in the literature (e.g. Rayleigh, Nakagami, Ricean, etc. Q, IfTTlI f. 
are assumed constant over local areas (i.e. at a microscopic level) liT21 . However, STE wireless 
channels are of stochastic nature with time varying statistics mainly due to the continuous and 
arbitrary change of the propagation environment if the transmitter, the receiver or objects between 
them move. The latter is the main reason why in this paper, we adopt a stochastic process with 
time varying statistics for modeling STE channels. 

Eor the models developed in [|T21l . fITSl . the inphase and quadrature components of the wireless 
fading channels are assumed conditionally uncorrelated gaussian random variables (thus condi¬ 
tionally independent). In the case of flat fading, the multipath components are not resolvable 
and can be considered as a single path. Then, the inphase, 7, and quadrature, Q, components 
over one link (e.g. (i,j)) can be realized as: 

dXi{t)=Ai{t)Xi{t)dt + Biit)dWi{t), X/(to), I{t) = CiXi{t), 
dXQ(t)=AQ(t)XQ(t)dt + BQ(t)dWQ(t), Xg(to), Q(t) = CgXgit), 

where X/(t), Xgit) are the state vectors of the inphase and quadrature components and {Wi(t)}t>iQ, 
{lTg(0}r>fo are independent standard Brownian motions corresponding to the inphase and the 
quadrature components respectively, defined over a filtered probability space (D,!F,{!Fdf>fo^P)- 





The same model describes every link with different parameter values A/(t), AQ(t), Bgit), 
Ci, Cq and (independent) Brownian motions Wqit), but this fact is not explicitly modeled 

for ease of presentation. The attenuation coefficient (in squared magnitude) is [fT9l a,j{t) = l{tf + 
Q{t)^. As in the case of LTF, the coefficients A/(t), Agit), Bj(t), Bgit), Ci, Cq can be obtained 
directly via signal measurements following the methodology proposed in [[T9ll . IfT^ using the EM 
algorithm together with Kalman filtering. This model leads to time-varying mean and variance for 
the inphase and the quadrature components and thus for the STF wireless channel and includes 
the Ricean, Rayleigh and Nakagami distributions as special cases IfT^ . 

In the rest of the paper, the vectors X{t), W{t) denote collectively (for all links) the channel 
states and the Brownian motions respectively at time t. Note that we assume that the wireless 
channels are uncorrelated. This assumption is also made in Il20ll . where it is argued that inter-link 
correlations do not impact the network capacity region and therefore the maximum utility. 

IV. System Model & Assumptions 

We consider a static wireless multihop network with N nodes and E directed links forming 
the set fi. The network serves F overlaying flows (source-destination pairs) over a finite duration 
(lifetime) [ 5 , T]. At time 1 6 [5, T], d^(0 data (e.g. packets) are produced from the source node i for 
its destination node d. Let Sr{d) be the set of sources for node d. Then, /l^(t) = 0, Vi iSdd), 'it 6 
[5, r]. We denote with r^.(t) the communication traffic on the link ii,j) for destination d at time 
te [5,r]. Then, R{t), A(t), denote collectively the variables {r^(0}vd,(i;> respectively, 

at time t. The set ’R{i,d) consists of the one-hop (out-)neighbors of node i which are allowed 
to serve as next-hop nodes towards d according to the routing protocol under consideration. If 
there are no routing constraints, we consider R.{i,d) = where 6 £}. Also, 

r^.(0 = 0, if j i 'R{i,d) and = 0, r^.(0 = 0, ii,d,t e [5,r]. Furthermore, we assume that the 
transmitter of the link (i,j), i.e. the node z, transmits with power at time te [5,r]. P(t) 
expresses collectively the transmission powers of all links at time te [5,r]. 

Each source node associates its satisfaction for its produced data for destination d, T^, at time 
te [5,r], with a time-varying continuous differentiable utility function Several utility 

functions used in literature belong in this category, such as the strictly convex and increasing 
a-fair utility, including the logarithmic one [|2T||. It is further assumed that UfiAf,!) is increasing 
with A‘1 and uniformly bounded as t ^ 00 . Also, a (continuous differentiable) cost function. 
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JijiPij), is assigned to each directed link (i,j) with respect to its transmission power 
te [5,r]. In literature, JijiPij) is often assumed to be a strictly convex function [|6l. 

The proposed cross-layer framework includes routing, scheduling, power and congestion con¬ 
trol. Routing (network layer) determines the amount of traffic for each destination that will be 
served by every link, by optimizing R(t), Vt 6 [5,T]. Scheduling and power control (MAC and 
physical layers) determine which links are going to transmit and their transmission power by 
optimizing P{t), 'it 6 [ 5 , T]. Finally, congestion control (transport layer) optimizes A(t), 'it 6 [s, T]. 
Therefore, the proposed cross-layer scheme aims at determining the optimal values of the control 
variables Pit), Ait), Pit), 'ite [5,r], according to an optimality criterion designed with the aid 


of the utility and cost functions defined above, considering the channel models of Section III 


Due to the considered underlying channel processes, the control variables R, A, P should be in 
general defined as stochastic processes. Let us define the value range for each A^, Ua = [0,/lmax], 
and the corresponding feasible set JJa = {d : [5,r] x D ^ : d is adapted}. Then, A e 

[0>^max], and the correspond- 


ii^. Similarly, we define the value range for each ri, Ur 
ing feasible set JJr = [r : [s,T]xQ. ^ Ur : r is {Tt}t>s adapted}. Then, R e Hr 


Ex{N-l) 


. Finally, 


we define the value range for each Ptj, Up = [0,/’max], and the corresponding feasible set 
JJp = {P '.[s,T]xQ^ Up : P is {Tt}t>s adapted}. Then, P e iif. We will use to denote 
expectations given the initial condition X(5) = x. 

At this point, we distinguish two cases with respect to the access to the wireless medium. 
Based on the two types of access, two cross-layer problems are developed. The first case concerns 
non-orthogonal access to the wireless medium, in which the transmitters are allowed to access 
the wireless medium simultaneously (one frequency carrier is assumed), while the interfering 
transmissions are considered as noise. For this case we define the Signal-to-Interference-plus- 


Noise-Ratio (5 INR) for the link ii,]) as follows: S INRijit) = 


/(O 


r, where la denotes 


OV J No+'Z(k,l)eIjjakjPklU)" ‘J 


the subset of fi containing the links that interfere with the link ii,j). Nq (Watts) stands for the 
average background noise at the receiver’s ij) side and atjit) is defined in Section depending 
on the fading type. The capacity of the link ii,j) is given by the Shannon’s formula in bits/sec as 
CijiPit)) = Bij\og 2 il +SINRijit)), where Bij iHertz) is the wireless channel’s bandwidth at link 
ii,j). The second case refers to the orthogonal access to the wireless medium, where only non¬ 
interfering links can access simultaneously the wireless medium. Orthogonal access decreases 
the complexity of the proposed framework’s operation in the physical layer (power control), as 
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it will be shown in later sections, while it is nearly optimal when interference is strong ||6l. In 
this case, the connectivity graph of the wireless multihop network is important in identifying 
the feasible schedules. Based on the latter, the finite set of all possible independent sets of links 
(i.e. links that do not interfere with each other) is constructed. Only links belonging to the same 
independent set can access the wireless medium simultaneously. In this case, the capacity of the 
link (i,j) is a concave function of Pjj, given in bits/sec as Cij(Pij(t)) = B,ylog 2 (l + 


V. Non-ORTHOGONAL Access to the Medium 


A. Problem Formulation (sr Analysis 


According to the discussion in Section IV the optimization framework, denoted as Pi, is 
formulated as follows. 


Pi := 


max 

,Ex{N-l) 


Ae^P, Petlf 


T ( 

[i,d:i€Sr(d) (ij) 




(t)dt -E 


rj-iOdt 


rT 

f ^ 

f.ie-Rad) 

*ys j 




rT 

ii 


r‘lj{t)dt 


f 

f ^ 

S K rni 


jen(i,d) 


Cu{Pit))dt 


dt 
s.t. 
, 'ii,d 


Pij(t)dt 


^ Pi,max ^ 


(3) 

(4) 

(5) 


The objective function expresses the trade-off between the accumulated for all sources util¬ 
ities/satisfaction of producing data and the accumulated cost due to power consumption for 
link transmissions. Thus, its maximization targets at improving energy efficiency by maximiz¬ 
ing source rates while penalizing the cost of power consumption for achieving them when 
Jij 0, 'i{i,j), i.e. when power control is applied. The first constraint relates to the flow 
conservation at each node and for each destination, used to ensure high throughput for the 
examined time interval [ 5 , T]. The second constraint relates to the capacity restriction (right side) 
due to power, channel and interference limitations for each link. Finally, the third constraint, 
relates to a limitation on the total power consumption of each node for the examined time 
interval, [5',r], (left side) according to its energy storage, denoted as P/,max > 0 (right side). 
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It is important to note that we eonsider continuous time network operation (thus, using time 
integrals), for ease of presentation, due to the continuous time evolution of the channel state 
(Section |l^. The case of discrete time network operation can be obtained trivially by replacing 
the integrals by sums where Ni is the number of time slots in [5, T] considered for 

the network operation and each denoted by L In this case the channel state will be sampled at 
each time slot as described in the subsequent sections. Furthermore, for considering an infinite 
T, we should also divide every integral by T, thus considering time averages. 

This problem is non-convex due to the forms of the capacity, utility and cost functions. Even 
if the utility and cost functions were concave and convex respectively as commonly assumed in 
literature, the problem would still be non-convex due to the capacity function forms. However, 
we will prove that its duality gap is zero, which is an important fact as it renders the Lagrange 
(dual)-based optimization method optimal. The latter allows for devising efficient algorithmic 
solutions as it leads to a separable optimization problem with respect to the variables of each 
layer while using the Lagrange multipliers for the communication between adjacent layers for 
achieving a cross-layer optimal solution. Let > 0, Vi,d, Uj > 0, V(/, 7 ) 6 fi, vy > 0, Vy be the 
Lagrange multipliers associated with the constraints Q, Q, Q correspondingly. Denote with 
L the whole set of the Lagrange multipliers. Then, the dual function is formulated as follows: 


La{L) = max 


t( 

S ■ J.;^C /,• 


■E 




yi,d:ieS rid) 


(ij) 

T 


dt 


f Af(t)dt+ r ^ rj.(t)dt- f ^ 


rjj{t)dt 


j:ie'Rij4) 


je'Rii4) 


^ kj^sA f ^^ijiOdt f 

: ...o JS j JS 


ii,j)eS 


Cij{P{t))dt 


z- 


nT 

I Yu 


( 6 ) 


Consequently, the dual problem of P\ is defined as Di := 

Theorem 1: The problem P\ has zero dual gap, i.e. if P*^ its optimal value and D*^ the optimal 
value of the dual problem, then Lj = D*^. 

To prove this theorem we proceed in analogy with Theorem 1 in lE^ . The proof relies on the 
fact that the channel’s cumulative distribution function (cdf) is continuous and thus no channel 
realization has strictly positive probability. It uses the definition of nonatomic measures and the 
Lyapunov’s convexity theorem 
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Proof: To prove the zero duality gap, we eonsider a perturbed version of the problem P\, 
obtained by perturbing the eonstraints used to define the Lagrangian. Let Pi (A) be the funetion 
that assigns to eaeh perturbation set A = the solution of the following 

perturbed optimization problem. 


Pi (A) = max ] 

Petif 


T ( 

f Z vfixfiD.n-Z-iiAPim 

\i4-ieSr(d) UJ) 


dt 

s.t. 


r..A rjffdt- r‘^ft)dt\ < AIj, yi,d (7) 


I d 


CiiiPit)) 


dt 


f.ieKUJ) 


<A2 V(/,y)6fi, 


jeK{i,d) 


pT 

I ^ PijiAdt 


-p 


I,max — 


< V/ (8) 


i.e. the eonstraints ean be violated by A amounts. In order to prove zero duality gap, we should 
show that the funetion Pi (A) is a eoneave funetion of A [|22ll . 

Let A = ({Aj^}vi,rf,{Aj^}v(;j),{A3}vO, A = ({A,-^}v/,rf,{A,j}v(ij),{A,-}v0 be two arbitrary sets of 
perturbations with respeetive optimal values Pi = Pi (A), Pi = Pi (A) and respeetive solutions 
(A,P,P) and (A,P,P). Then, for an arbitrary a 6 [0,1], we define the perturbation A = aA + (l - a)A 
and for feasible solutions (A,P,P), i.e. satisfying the eonstraints (|^, we need to show 


Pi (A) = Pi(aA + (l -a)A) > aPi(A) + (l -a)Pi(A). 


(9) 


Consider the set of all possible state (A) realizations Pf and the Borel field, B, on Pf. For 
A 6 B, let be the expeeted value restrieted on ehannel realizations ineluded in A. We define 
the following measures. 

T r 

-d 


OM 


'^S,X 






Wij{A) 

vu(A) = 


3 A 


fidiA) = 
T 




I 


T 


XjiAdt 


.El 


, Vf, J : i 6 S r(d), 

T 


^ 

Ai {t)dt 


I 


Cii(P(l))dl 


.El 


5 A 

"^S.X 


T 

f fj(PijiA)dt 

Js 


.El 


I 

r 


Cij(P(t))dt 


Jij{Pij(t))dt 




3 A 

"^S^X 


T 

f lip)dl 


.El 


r 


Pii(t)dt 


, Vi,d, 
, V(iy)6fi, 
, V(ij)6fi, 
, V(i7)6fi, 


( 10 ) 

( 11 ) 

( 12 ) 

(13) 

(14) 
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while we also define 0,^(0) = (pidi^) = Wij(<Z>) = v,y(0) = ^iji0) = 0. These measures are nonatomie 
II 22 II sinee the ehannel edf is eontinuous and all the eontrol variables are bounded. Thus, there are 
no ehannel realizations with positive measure, i.e., 0id(A) = (pid{A) = Wij{A) = Vij{A) = ^ij{A) = 0 
for all singleton sets Ae'H. Let VL(A) be the veetor measure expressing eolleetively all measures 
did,(pid,Wij,Vij,^ij, whieh is also obviously nonatomie. Then from Lyapunov’s eonvexity theorem 
[|22|. the range of W is eonvex. Therefore, the value wq = aW{^) + {l-a)W{0) = aWCH) belongs 
to the range of values of W. As a result there exists Aq e B sueh that VL(Ao) = aWi'H), i.e., 
Gid(Ao) = aOidCH), (pidiAo) = a(pid{pH), ete. Moreover, due to the additivity of measures, for the 
eomplement of Aq, A^, we have VL(Aq) = W{'H) - W{Aq) = (1 -a)W{9P). Then, we define the 
following eontrols for the new perturbation A. 

= + V-a.s. (15) 


df (0 = 


/1^(0 within Aq 
A^(t) within A^ 


Pu(t) = 


sinee A, A e , R, R etl, 


P- Xt) within Aq 

' 'ii,d : i e S r{d),'i{i,j) e[s,T\, P-a.j'. 

\Pij{t) within A; 

‘I 


,jy,j vvitiiiii 

, P, P e Up, it also holds that A e tPj ., R e HAr 


F D D D D ^nE If tUof A ^<7/^’ P <7 


rp A. 

Alp. Now, based on the above, we eheek if the eontrols defined above for the perturbation A 
satisfy Ineqs. (|7]), @ and if Ineq. @ holds. For the eonstraint Q, we have: 




pT 



dt 

II 

1 ^pt)dt 

+e 5 

rT d 

I Aj {t)dt 

/ 


S 


aJ s 


f E 'l-w- E Xft) 

r.ien{j4) imud) 

f (arj.(t) + (l-a)rj.(t)jdt- f ^ (arfj(t)+ (1-a)rfj(t)jdt 


+ 


j:ie'R(j,d) 


je'Rii.d) 


aEr 


+(1 -a)Es 


T 

J" df (t)dt + 


rT 

I .1. 


j:ie'R{j,d) 


Af(t)dt + 
rT 

I £ 


£ E E X 


■(t)dt 


j:ie'R(j,d) 


je'Rii.d) 


rji{t)dt 


rfjipdt 


jmud) 


^«4L + (l-«)A/,rf = AJ ..(16) 


With respeet to the first eonstraint in Q, we have: 


r 'ZiTfj(t)dt 

Js , 


Qmt))dt 


+(1 -a)Es 


r 

T T 

J Cij(P(t))dt 


T T 

^ S j k) S 


iP{t))dt 


<aA2 +(l-a)A,, = A2 (17) 
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Similarly, with respect to the second constraint in we have: 


X T 

Z 

jeNf' 


Pij(t)dt 


-P 


- 

^,max “ ^s,x 


rT 

f ^ 


Pij{t)dt 


+ ] 


aE 


S,X 


T 

I Z &/')* 


'S 


+ (1 £i[)Ej.^j[ 


j^l^out 

nT _ 

I Yu 

Js j^^out 


rT 

I ^ 

^ ‘ 5 ’ •_ » rn/j 


Pii{t)dt 


-P 


z,max 


j^p^out 

-/’,,max<aA3 + (l-a)A^ = A3.(18) 


Finally, Fi(A) >: 


// (Zm:.- 65 ,W t/f(^f(0,0 - Z(,,,) Jij{Piji.t))) dt\ i.e.. 


Fi(A)>=Ef« 


+E?. 


yi,d:ieS rid) 

which concludes the proof. 


f z 7 ( 6 / 0 ) 

[i,d:ieSr(d) 

f y uf(if(t),t)-yj,j(Pij(t)) 

Js • /jv fni 


dt 


ihj) 

aFi(A) + (l-a)Fi(A) 


(19) 


B. Problem Solution 


Since the dual gap corresponding to the problem P\ is null, we can obtain its optimal value 
by solving its dual problem via a subgradient methodology [|23l. The subgradient algorithm, 
repeatedly renews the Lagrange multipliers until converging to their optimal solutions. We use the 
symbol 77 = {0,1,..} for the repetitions of the subgradient algorithm. Then, the renewal equations 
of the Lagrange multipliers take the form: 


yuf(77 +!) = <! 77/(77) + K{r]) ■ E^,;c 


Af(t)dt + 


X ..Z E 


rfj (t)dt 


j:ie'R(j,d) 


tmud) 


, V7,J,(20) 


hjid + 1) = 1 lijid) + Kid) ■ 




1\ + 


(t))dt 


, V(7,7)6fi,(21) 


V/(77+l) = \vi{ii) + K{ri)- 


rT 

f ^ 

76A7“ 


+ 


p-mt-Pi 


V7.(22) 


where {}■*■ denotes projection to [0, 00 ) and the values ///(O) > 0, Vi, J, /,y(0) > 0, 'iiij) e £, v,(0) > 
0, Vi, are considered given. The subgradient method is known to converge to a close neighbor¬ 
hood of the optimal values for the Lagrange multipliers if constant step-size, K{ri), is used, while 
diminishing, non summable but square summable step size allows for convergence to the optimal 
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values [|23l, 04ll . The values of the stoehastie proeesses A^*, Vi,d, rf*, V{i,j),d, P*., V(/, 7 ), are 
eomputed while obtaining the dual funetion (Eq. ([^) with the eurrent solution for the Lagrange 
multipliers, i.e. for the iteration tj. For performing this maximization, we ean observe that one 
eannot aehieve a better objective value than the one achieved by choosing at each time 1 6 [ 5 , T], 
each control variable optimally as a function of X{f) and the current values of the Lagrange 
multipliers (iteration 77). Therefore, at the iteration rj, given V/,J, lijirf) 6 &, viirf), V,-, 
the controls are computed as follows: 

• The optimal Af*, 'ii,d : i e Sr(d), at the transport layer, are computed source-wise by 

dUf(Af,t) 


&A^ 

I 

id* 


-iu^{rj) = 0y te[s,T], 


(23) 


while taking into account that 6 U^. From Eq. (23), it is observed that A^j* is time- 
varying but not random as it depends only on the deterministic Lagrange multiplier 
(which is constant in time t 6 [ 5 , T]) and the deterministic time-varying utility function U‘1 
but not on the channel state X(t). In the case that UfiAfj), 'ii,d : i e S r(d) are invariant 
with t then T*, VqJ : i eSr(d) are constants over [5,r], too. 


The optimal routing variables rf*, 'i{i,j),d (network layer) are computed by 


Z 


maxV , 

d {Ui)\ieR{i4) 


rf.(Mf(7i)-/An)-lijm, ^te[s,T], 


(24) 


i.e. rf*{t) =i?max, V t 6 [s,T], if > 0, while it is observed (from Eq. 

(24)) that each rf* is constant in time. 

The optimal transmission power values at the physical layer, P*, are computed via solving: 


max ^(-JijiPij) + lij(r])CijiP) - vArffPit e[s,T], 


(25) 


dj) 


while considering the Up constraints (Section [TV]). From Eq. (25), it is observed that P is 
a stochastic process since the link capacity C/y, V(/, 7 ) depends on the stochastic process 
X(t) representing the wireless channels (Section [TV]). 

The computation of the expected values involved in the Lagrange multipliers’ renewal equations 
requires Monte Carlo simulations. However, since the controls A*, R*, have been shown to be 
deterministic, the expected value involved in the renewal equation of the Lagrange multipliers 


nf, 'ii,d (Eq. (20)) is superfluous. For the rest of the Lagrange multipliers, the expected values 
are obtained via the following algebraic computations. 







16 


Firstly, the processes : t > 0} are discretized [|25]| . We compute 6t = where n is a 

design parameter representing the number of samples of the channel over the time interval [ 5 , T] 
of the network’s operation, and we sample on the time instants {rt = s+ b ■ 6t}b=i:n- In view of 
(|^ it is not hard to see that for every i,j and b we have 

Xi j{Tb) = pi j{b)Xi j(Tb-i) + ^i j{b) + Zi j{b) 


where 


rn 

Pij(b) = exp(- pij{s)ds) 
Jn-i 


^ij{b)= r /3, 7 ( 5 ) 7 ,exp (- r /3ij{q)dq)d 

JTh-l Js 


and 


Zij{b)= r 5 , 7 ( 5 ) exp (- r l3ij(q)dq)dWij(s). 

JTb-\ Js 


Note that {Zij(b)}iib are independent random variables with distributions N{Q,cn {b)), where 


O' 


o-lib) 


pTb r 

I 5j(5)exp(-2 I 
Jzb-l Js 

The discretized scheme then becomes for every 


/3ij(q)dq)ds. 


XijiTb) = Pij{b)Xij{Tb- 1 ) + C,- jib) + (Tijib)^ijib), b =1,2,...,n, Xfjis) = xtjo 


(26) 


where {^ijib)}ij^b are independent samples from a standard normal random variable. After nu¬ 
merically computing the solution of the SDE Q, we compute P*iTb) for each b from Eq. ( |25| ) 

cT 

and we use a Riemann sum approximation for a sample of the integral CijiP*it))dt, that 


is CijiP*it))dt - rbloCijiP*iTb))6t, where CijiP*iTb)) = Bij\og 2 


1 + 




Nq+ Z 
{kfielii 


(Sections III, IV). Einally, we repeat the above procedure M times to obtain M independent 
samples of the preceding integral, and we average these samples to estimate the expected 


capacity of link ii,j) over the time interval [5,r], i.e. 

-r 


Eq. (21). Similarly we obtain 


Is P’ijW 


jJCij(P\t))dt 


, appearing in the 


. Since the computation of P* from Eq. 


25) 


ues 


involves the Eagrange multipliers’ values, the Monte Carlo computations of the expected va’ 
should be performed at each iteration of the subgradient algorithm. Notably, pijib),^ijib),aijib) 
are deterministic so we only need to compute them once. 
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The optimal power alloeation problem at the physical layer, i.e., the solution of Eq. (0 
determines the complexity of the whole problem since everything else is simple algebraic 


computations. Indeed the computations of Eqs. (23), (24) can be distributed to the sources and 
links correspondingly. This cross-terminal optimization problem at the physical layer constitutes 
an important challenge in wireless networking [| 2 ^ which is treated in other works in literature 
[|22l, ll24ll and is out of the scope of this paper. In the next section, we formulate and solve 
the same problem in the case of orthogonal access to the wireless medium where the capacity 
functions take much simpler concave forms leading to tractable analytic solutions. 

We summarize below the steps of the algorithm proposed in this section for obtaining D*^. 

1) Initialize the Eagrange multipliers, rj = 0, /o(0), v,(0), V,. 


, V(/,y), as described. 


2) Compute A^*, n* '^(i,j),d using Eqs. (23), (24) respectively. 

^ u _ _ 

3) Compute the expected values X Cij{P*(t))dt , Esx P* (t)dt 

^ kJ S d ^ kJ S IJ 

4) Compute //^(//-l-l), V/,J, lij{r]+\), Vi(r]+l), V,- from Eqs. (20), (21), (22) and 

set ?7 <— 77 -I- 1 . 

5) Repeat steps 2, 3, 4 until convergence. 


C. Discussion 

It is important to note that the time scale of the renewal of the Eagrange multipliers should 
be distinguished from the time interval [ 5 , T] of the network’s operation. In principle, the above 
algorithm should run off-line, i.e. prior to the network operation to determine the optimal source 
rates, routing variables and Eagrange multipliers and afterwards, the online network operation 
will be designed based on these optimal values and the solution of the cross-terminal power 


allocation problem of Eq. (25). Note that convergence of the dual variables close to their optimal 
values does not imply convergence of the primal variables except if the primal variables change 
continuously with respect to the optimal Eagrange multipliers (e.g. source rates). Eollowing the 
approach of [[24l . we can compute optimal routing variables while performing the subgradient 
iterations. Specifically let as assume that No is the total number of subgradient iterations, 
while the index rj e 0,...,No-l is used to distinguish each one iteration. Then, if applying 

n.{t,No) = —— xp -, Vii,j),d as optimal routing variables for each te [ 5 ,r], we can achieve a 

close to the optimal value of Pi, using diminishing step size. This can be proven as in [l24ll . if we 
first reformulate P\ in an equivalent form replacing the objective function by the optimization 















18 


variable P' and adding the eonstraint 


Then, obviously, Theorem holds. More diseussion on a possible (suboptimal) online imple¬ 
mentation of the proposed algorithm is made in Seetion VII[ 

We also note that instantaneous values of the eontrols (online approaeh - as functions of X(t)) 
during the network operation for such a problem may be obtained via a dynamic programming 
solution methodology (Hamilton-Jacobi-Bellman partial differential equation (HJB pde)) [|T4ll 
which adds dramatically to complexity for a wireless multihop network (specifically the solution 
of the HJB pde is completely inefficient [|27l . [|2^ 1. 


VI. Orthogonal Access to the Medium 

In this section, we redesign the problem Pi allowing only orthogonal access to the wireless 
medium, and thus leading to convex link capacity forms (Section [TV] ) since the noise from 
interference will become negligible. In order to achieve this, we introduce new optimization 
variables for each independent set t, denoted as n^, expressing the activation percentage of the 
corresponding independent set at time te [5,r], and further satisfying the relations: ^ 

1, 0 < nL{t) <1, Vi,t 6 [5,r]. In the following, H stands for the collection of all Ui, Vt and In is 
the number of the independent sets of the network’s connectivity graph. Since the channel state 
is a stochastic process, similarly to the definition of the rest of the control variables (Section 
Tv] ), we define the value range for each C/;r = [0,1], and the corresponding feasible set % = 
[n : {s,T]xQ. ^ Un : n is {Tt]t>s adapted}. Then, H 6 Hn = ^1, Vt e [5,r]}. 

The new optimization variables impose time-sharing among the independent sets, thus they 
render the interference levels negligible and the capacity of each link (/, j) is given by the concave 


function in Section |IVj The time share corresponding to the link {i,j) at t 6 [5,r], is given by 
The new optimization problem P 2 is formulated as: 


Pi '■= max Ei ;c 

Ae'Wf, ne-Wn 


t( 

f Z t'fufw.o-E Z 


r(d) 


(ij) 


dt 


s.t. 
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f 'ffW*+ f Z 


nXt)dt 


j:ie'R(j,d) 




T 




Js I 




‘’S,X 


je^(i,d) 

nT 

J ^ n,{t)Cij{Pij{t))dt 


'ii,d 


^S,X 


-r 




(27) 


(28) 




Vi 


(29) 


r E E 

ds j^f^out 

The formulation of P 2 is similar to the one of Pi (Seotion|V]), with the difference that in P 2 , we 
have introduced the new optimization variables fl 6 V/n, the link capacities are concave and the 
link transmission powers, Pij(t), the link costs with respect to the transmission powers, Jij(Pij(t)), 
and the link capacities, Cij(Pij(t)), are replaced by their effective values 

Zi:(ij)eL^i(t)Cij(Pij{t)), Correspondingly O. ^2 is non-convex due to the 
appearance of the control variables in multiplicative form in the objective function and the 


constraints (Eqs. (28), (29)) in addition to the general forms of the utility and cost functions. 


However, in a similar way as for Pi, it can be shown that P 2 has a zero duality gap. Let 
> 0, 'ii,d, Uj > 0, V(/, 7 ) 6 S, Vi > 0, Vf, be the Lagrange multipliers associated with the 


constraints (27), (28), (29), respectively. Denote with L the whole set of the Lagrange multipliers. 


Then, the dual function is formulated as follows: 


La{L) 


Ae-Wf, 


max ^s,x 

PeO^l, ne-Wn 


-E 


Pi 


i,d 


T ( 

I E <(Vw.')-E Z 

r 


\i,d:ieS r(d) 


(ij) i:(iJ)eL 


d 


X‘l{t)dt+ r ^ rj-{t)dt- r ^ rfj{t)dt 
r.ienu,d) jem,d) 


(iJ)eS 


dt 


-Z 


V,i 


nT 

z z ni(t)Pij{t)dt-Pi, 


T 

f Zd/»- Z 'T.COC.,■(/>,;«)) 

^ \ d ) 

Then, the dual problem is defined as D 2 := inf/^(L^(L)). 

Theorem 2: The problem P 2 has zero dual gap. 

The proof is briefly described in Appendix B, provided as a supplementary file, as it is very 
similar to the proof of Theorem Now, we obtain the optimal value of the problem P 2 via 
solving its dual. The renewal equations of the Lagrange multipliers are given by (77 = {0,1,2..}): 


^ii{rl+\) = \^i%rl) + K{r|)■ 


J^^Af(t)dt + J^^ ^ rfm-£ ^ 


rf;m 


j-ieKUd) 


je'R{i,d) 


.(30) 


, V7,J,(31) 
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lij(T]+\) = \lij{7]) + K(T]) 




1 + 


r.{iJ)eL 


, V(/, 7 ) 6 fi, (32) 


Vi(T]+l) = \vi{7]) + K{T])' 


■^S,X 


T 

I E E n*(t)P*ft)dt-P 

i,r] 


+ 




, V/. (33) 


with given values /if(0) > 0, Vz,(i, /,/0) > 0, V(z, 7 ) 6 fi, v/(0) > 0, V,-. 


The optimal values of the stoehastie processes Af*, r^^J, 'i{i,j),d, for each zy are computed 




by Eqs. (23), (24) correspondingly and the same observations hold. Regarding the optimal values 
P*y Gfi, n*, Vi, for each 77 , they are obtained by solving V [ 5 ,r]: 


max Yj J] (l,j(d)CijiPij) - JijiPij) - v^{ri)P,j) 

(ij) 


= T^E’’‘ E («';)C.Xf.7)-./.Xf,7)-Vi(>;)fi;),(34) 


which constitutes a maximum weight matching problem over the independent sets. Specifically, 
for its solution, each link (i,J) computes the stochastic process P* (0, te [ 5 ,r] (depending on 
the state’s, X, path) by maximizing -Jij{Pij) + lij{T])Cij{Pij)-Vi{r])Pij, i.e. solving 


mj 


+ kjin) 


mj 


- Vi(r]) = 0 , 


vt6[5,r]. 


(35) 


while taking into account the Up constraints (Section |W]). Then, each link {i,j) efi is assigned a 
weight equal to We(i, j, t) = (^-Jij{P*j(t)) + lij(ri)Cij(P*j(t)) - Vi{rf)P*p)^ and finally the independent 
set i* maximizing the sum 2 (!j)ei l^e(fi 7 V) receives 7 rt *(0 = 1, while ;r((t) = 0 for z z* atte[s,T]. 
In this paper, we assume that ties break arbitrarily, however, a study on how to break ties can 
be found in flbl. 

The computation of the expected values involved in the Lagrange multipliers follows the 
lines of the Monte Carlo simulations described in Section |V] and the algorithm for solving 
D 2 is similar to the one in Section |V| Note that Eq. ( [35] ) can be solved link-wise in a very 
efficient manner, contrary to Eq. (|2^ which involves the complex cross-terminal problem. The 
observations regarding the convergence to the optimal Lagrange multipliers and primal values 
are of similar nature to the ones of Section |V| At this point we study the solution of Eq. ( |35| ) 
in more detail in order to gain more insight regarding the optimal power control. Let us assume 
LTE and convex link costs of the form Jij{Pij) = VP'^j, where V > 0 is a constant for all (z,y) 6 fi. 
Then, for a given zy, the solution of Eq. ([35]) is explicitly given by: 


P*-{Xij{t)) = max|0,min{EyX,/0),^max}}, where 
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p*j(Xu(ty) = 


1 


Noe 


-KXijU) 


Vjin) 

2V 


+ 




-KXij(t) + 


Vi{ri) 

2V 


Vi(r])Noe ^Nj(t) lijjrfjBjj \ 

2V 2yiog(2) / 


Note that the optimally controlled power at rj never exceeds the value 


p* max _ _ 
~ 2 




2V I 2yiog(2) 2y 


(37) 


irrespectively of the Pmax value, while this value is achieved asymptotically when Xij(t) -co. 
Note also that P*.{Xij{t)) 0 when Xij{t) oo. Therefore, the optimal power control exploits 

low power loss values created by random fluctuations to increase the link capacity as much as 
possible, thus positively affecting the flows’ throughput (rates). On the other hand, transmission 
power is not wasted when the power loss is high. Note that in case of orthogonal access to the 
medium the aim of power control is not scheduling (which is defined via the fl variables) but 
to take advantage of the channel when it is favorable and to avoid depleting energy when the 
channel is destructive. 

In the following, we assume no power control and scheduling and we prove an interesting 
counter-intuitive theorem regarding the relation between the achieved utility by the network and 
the channel’s diffusion coefficient in the case of LTF. Absence of power control means that in P 2 , 


Jij{t) = 0, [5,r], the constraint of Eq. (29) is dropped and finally, Pij{t), [5,r] 

are constant and predefined. Absence of scheduling means that the time share of each link is 
constant and predefined, e.g. = ^ij ^ 


A. Utilities as Increasing Functions of the Channel’s Diffusion Coefficient in the case of LTF 

We examine the effect of the channel’s diffusion coefficient, on the users’ optimal utility. Con¬ 
trary to what is perhaps expected, we prove that an increase of a channel’s diffusion coefficient 
(SDE ([^) leads to increased achieved users’ utility. This result emphasizes the importance of 
a more realistic model for the power loss such as the one of SDE ([^, as opposed to the mean 
power loss model used in the conventional NUM problem formulation. 

Theorem 3: Eet us consider two networks 1, 2, one noisier than the other, but otherwise 
identical. Precisely, for ke {1,2}, V{i,j), Tte [to,T], 

dX^jit) = /3,j(t)(yij(t) - X^jit)) dt + 6\ft) dwfjit), X^jito) = and ^(O < ^(r). (38) 

If 7^, k 6 {1,2}, is the optimal objective value achieved for each network, then 7* <7^. 


(36) 
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Proof: The solutions of the SDEs in Eq. 


JtQ 


ean be written, V(/, 7 ), as 

2 }, 


(39) 




where = e ■''o 


Note that 


-^90 + jfo 
det, 


Cj8ij(s)yij(s)e X is the solution for a noiseless ehannel. 


ke{h2}. 


, (c) , (c) 

By Proposition 3.1 in 11281 we have that Xk(t) < X^.{t), Vte [to,T], where < stands for partial 
ordering in the eonvex order. That is, for every eonvex funetion ij/ we have BtQ,xo ^ 

[i/r(X^.(t))j, Vt 6 [to,T]. One sueh eonvex funetion is Shannon’s formula for the ehanneTs 


■‘to,xo 


eapaeity C,y, i.e. x B,jlog 2 ( 1 + 


e'^xp. 

~W^ 


. Henee, 


■^tO,XQ 


[cjj(t)]<Et,,xo[cjjit)], ^te[to,T]. 


(40) 


In partieular, let us denote by 6 {1,2}, the set of the deterministie A 6 Idf, R 6 
that satisfy the eonstraints of P 2 imposed on eaeh network: 


■^to,Xo 


f Af(t)dt+ f V 4(0 


■^tO,Xo 


'^0 pienad) 




■’to,xo 


pT 

I ^ 

Jemd) 


r‘fj{t)dt 


'ii,d. 


pT 

I 


(fdt 


- ^to,Xo 


f 

Jto 




, k = {l,2}. 


(41) 

(42) 


In view of Rel. (|40|) we have that c therefore, as asserted 


7, = max : 
A, Re &^ 


■^tQ,X0 


f Erio?(‘). 

*ytn : J 


t)dt 


i,d 


< max ; 
A, Re &^ 


■‘t0,X0 


f YjUf(Afit),t)dt 

Jto : J 




(43) 


Remark 1: Note that C,y(d,y(.)) > [ log 2 (1 + ^4^)] > P(Ao)B,y log 2 


Pij ^ 

No + log 2 


E^^[X,jit)], 


No Ao ' log2^ 

where Aq = {Xij{t) > E[X/2(0]}- Sinee Xij{t) are gaussian, P(Ao) = 1/2 by symmetry, and E^o[X,y(0] = 
where V(Xij(t)) is the varianee of Xij(t) given by dfj(r)exp(-2 Pij(q)dq)dr. 


iEKy(0]+ 


2n 


Therefore, the link eapaeity may take arbitrarily large values if £ 5£{t)dt is suffieiently large. 


VII. Numerical Results 

In this seetion, we present and diseuss indieative numerieal results evaluating the proposed 
sehemes foeusing on the ease of orthogonal aeeess to the medium and ETE. After deseribing the 
evaluation setting and some general observations, we illustrate numerieally Theorem and the 
behavior of the proposed framework in ease of eongestion eontrol and routing (i.e. optimization in 
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transport and network layers). The latter is then eompared with the behavior of the joint routing, 
seheduling, eongestion and power eontrol seheme (i.e. eross-layer optimization). In addition, 
we examine the behavior of the proposed framework in the ease of time varying utilities and 
the possibility of applying the solution procedure of the dual problem D 2 , during the network 
operation (online deployment). 

We consider a wireless multihop network of = 16 nodes, forming a 4x4 grid topology. For 
ease of presentation, we consider that the parameters of the SDE (|^, yij{t),Pij{t),6ij{t), as well 
as the initial states Xij{s) = x are identical for every link Here, we consider M = 200 paths, 
Nq = O.IVF, s = 0. Furthermore, Bij = lO^Hz, yij{Tb) = y^l +0.15e^“^'^^sin(10;r^)j 


Eol, XijiO) = y, n = 500, and /3ij(Tb) = 100, y = lOdB unless differently mentioned. Moreover, 
Sij{Tb) = 5,'i ( i , j ), Tb , where 6 will be tuned in each numerical experiment. Note that the value n = 
500 determines the sampling rate for computing the Riemann sums that approximate the integrals 


e.g. in Eqs. (32), (33) and it is chosen so that the Riemann sum is close to the corresponding 
integral value, while simultaneously being small enough for trading-off the cost of sampling. 
Eow sampling rate impacts performance since the Riemann sum does not converge to the actual 
value of the corresponding integral. On the contrary high sampling rate may induce extra cost 
without offering significant improvement in the Riemann sum’s accuracy in approximating the 
corresponding integral. The periodic behavior of the ETE wireless channel parameters may be 
due to an absorbing obstacle intervening periodically between the transmitter and the receiver (as 
in an example of IfTTl ). In the absence of scheduling optimization, for each link (z,y) the value 
is computed based on scheduling all the maximal independent sets of the network topology for 
equal percentage of time. Regarding the traffic model, each node chooses a random destination 
among its non-physically connected nodes, and becomes the source for this destination. Initially, 
we consider logarithmic utilities, i.e. Uf(Af) = log(/l^), a common choice in the literature to 
model elastic traffic ff291l . 

Each numerical experiment for the determination of the optimal control variables and the 
optimal Eagrange multipliers runs until convergence is ensured and specifically until the sum 
of the changes between consecutive values of the Eagrange multipliers over the preceding eight 
iterations is less than 0.001. The learning rate is chosen as K(ri) = ^, 'ir] [|23]|, where A' = 0.1 so 
that convergence is allowed in a reasonable time duration with respect to the chosen convergence 
criterion. Specifically, by decreasing A' by one or more orders of magnitude our criterion of 
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(c) (5 = 20, /3 = 10 for n < 166, p = 100 
for 166 <Tb < 333 else p = 500. 


Fig. 1. Wireless channel’s LTF stochastic behavior. Paths for the power loss (dB) modeled via SDE. 


convergence is satisfied too soon, impeding the subgradient algorithm approach to the global 
optimal values. On the other hand, increasing A' or using constant values of K{ri), V ?7 do not 
lead to convergence within a reasonable time interval. 

In order to obtain an intuition regarding the wireless channel’s stochastic behavior. Figs. l(a)[ 
l(b)| show typical sample paths of the solution to the SDE Q for d = 25 and 6 = 50, respectively. 


As expected, we observe larger deviations of the power loss from for the higher choice of 
5. Consequently, the capacity may achieve higher values due to random fluctuations in this case. 
Note that although the curve of yij{-) tends to weaken to a line as time increases, it fluctuates 


considerably for the duration of the network’s operation (transient state). Fig. 1(c) shows typical 
sample paths of the solution to the SDE Q for time varying speed of adjustment /3ij(Tb). When 
/3ij(Tb) attains low values (i.e. Tb < 166) the power loss diverges more from its attraction curve 
yiji^b), while the attraction to yijirb) becomes faster when fiijirb) = 500 (i.e. Tb > 333). 


A. Congestion Control & Routing 

In the sequel, we examine the case of applying only congestion control and routing, assuming 
the transmitter of each link (i,j) has a constant power of Pij(t) = 2W, V 16 [0, T]. Fig. |2(a)| shows 


the optimal source rates (i.e. after convergence since they change continuously with respect to 
the optimal Eagrange multipliers) for different choices of the diffusion coefficient 6. It can be 
observed that as 6 increases, random fluctuations to higher capacity values are exploited to offer 
increased optimal source rates, hence verifying numerically the statement of Theorem It is 
important to note here that the noise level 6 does not affect the mean power loss, as indicated in 
the proof of Theorem In other words, if the mean power loss is used to determine capacity. 
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(a) Optimal source rates (bits/sec) vs. S. (b) Convergence of the Lagrange multi- (c) Convergence of the Lagrange multi¬ 
pliers pliers {//jlvcu)- 

Fig. 2. Congestion control & routing: Optimal source rates and convergence of the Lagrange multipliers. 


higher capacity values due to random fluctuations cannot be tracked and exploited for increasing 
the source rates. Time-varying 6 (TV) is also applied, and specifically 6 = \5sin(l0nd/n) + 35 
i.e. taking values between 6 = 20 and 6 = 50, thus leading to optimal source rates in between 
the ones corresponding to these two values of 6. For benchmarking purposes, in Fig. |2(a)| we 


have added the case of d = 0, which corresponds to time-varying but deterministic channels. 
We observe that the optimal source rates achieved under deterministic wireless channels are the 
lowest (approximately the same as in the case of a low value of noise, i.e. the case that 6 = 5), 
indicating the improvement in system’s performance when accounting for randomness. 

Figs. 2(b)[ 2(c) depict the behavior of the proposed scheme considering convergence to the 
optimal Lagrange multipliers. We also study the impact of T on the time to convergence and 
the achieved source rates. The value of n is adapted for each T as it is shown in Fig. |3(a) We 
observe that as the duration of the network’s operation, T, increases, the time to convergence 


also increases (Fig. 3(a)), while the achieved arrival source rates decrease for all flows (Fig. 
3(b)|). Finally, the behavior of the proposed algorithm in case of time varying fSijit) with respect 


to the optimal source rates is shown in Fig. 3(c) We observe that when Pij{t) is high at the 
beginning (close to time 5 = 0) the optimal rates are higher than when Pijit) is initially low and 
increases later in time. 


B. Joint Scheduling, Routing, Congestion & Power Control Scheme 

In order to evaluate the joint scheduling, routing, congestion and power control scheme, we 
assume that each link can vary its transmission power between IW and 3W = Pi,max, V/. The 
network topology and traffic along with the rest of the parameters remain the same as in the 
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(a) Impact of T on the time to conver- (b) Impact of T on the optimal flows’ (c) Impact of time varying Pijit) of the SDE 
gence (iterations). rates (bits/sec). on the optimal flows’ rates (bits/sec). 

Fig. 3. Congestion control & routing: Study of the impact of T and time-varying yS on convergence. In subflgure (c), black 
corresponds to /? = 10 for ti , < 166, yS = 100 for 166 <Tb< 333 else fi = 500, red corresponds Xa p = 500 for ti , < 166, yS = 100 
for 166 <rj, < 333 else p = 10, and cyan corresponds to p= 100. 


previous experiments. Fig. 4(a) depicts the optimal transmission power at each repetition of 


channel state’s sampling derived from Eq. (36) and the corresponding path of the link capacity. It 
is observed that the optimal power increases when power loss decreases (thus capacity increases) 
and attains low values for high values of power loss, as expected from the analysis of Section [VT} 
Therefore, the transmission power increases only when there is an opportunity for an important 
capacity improvement due to random dips of power loss. On the contrary, transmission power is 


not wasted when the stochastic power loss does not support capacity increase. Fig. 4(b) shows 
the optimal source rates (i.e. after convergence) for different choices of the diffusion coefficient 


6 . As in the previous case (Fig. 2(a)), it can be observed that as 6 increases the optimal source 
rates increase for all flows. This is beyond the scope of Theorem that does not account for 
power control and scheduling in the optimization problem. Fig. 4(b)| also includes the optimal 
source rates when 6 is time-varying (TV) and when channels are deterministic (d = 0), leading 
to similar conclusions as in the case of congestion control and routing (Fig. 2(a)). Figs. 4(d) [ 
|4(e)| depict the convergence to the optimal Lagrange multipliers. 

Fig. |4(c)| shows that the joint scheduling, routing, congestion and power control scheme 
improves the optimal source rates for all flows, compared to the congestion control and routing 
scheme. As also stated in IfTTII . applying power control at the transmitter is like having channel 
state information at both the transmitter and the receiver which improves the network capacity 
compared with the case of constant power which is equivalent to having channel state information 
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(a) Capacity (bits/sec) & optimal trans- (b) Optimal source rates (bits/sec) vs. 6 . (c) Comparison of optimal source rates 
mission power paths (W) (6 = 20). (bits/sec) with and without scheduling 

and power control (6 = 20). 




(d) Convergence of the Lagrange multi- (e) Convergence of the Lagrange multi¬ 
pliers pliers {//ylviy)- 

Fig. 4. Routing, Scheduling, Congestion & Power control. 


at the receiver’s side only. Furthermore, we study the expected per link transmission power over 
the entire time interval [0, T] for the numerical experiments of Fig. It can be easily computed 
that it is equal to 1.0399IF for d = 50, 1.26581F for d = 20, 1.56341F for d = 5, 1.6249IF for d = 0. 
On the one hand these values are much smaller than the constant power of 2IF used to evaluate 
the routing and congestion control scheme (Fig. 2(a)| ), thus achieving a more “green” network 
operation in addition to throughput improvement (Figs. |4(b)[ |4(c) I leading to energy efficiency. 
On the other hand, we observe that as d increases, the expected per link transmission power 
decreases, indicating the importance of taking randomness into account in operating wireless 
channels with energy efficiency. 


C. Time Varying Utilities U Online Deployment 

Finally, we study the case of time-varying utilities when applying routing and congestion 
control. The utilities take the form t e [5,r], s > 0 Vi,d : i e Srid), i.e., they 

decrease with time modeling the decreasing willingness of users to produce high data amounts 
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(a) Optimal functions (bits/sec) to which 
the source rates converge (6 = 20) for 
time varying utilities. 



(b) Impact of n on the time to conver¬ 
gence (iterations) for time varying utili¬ 
ties. 



(c) Impact of n on the time to con¬ 
vergence (iterations) for time invariant 
utilities. 


Fig. 5. Routing & Congestion control: Time varying utilities & Impact of n on convergence. 


when approaching the end of the network’s operation. The optimal function to which the source 


rates converge over [5, T] is depicted in Fig. 5(a) We observe that as time increases, it dominates 


over the Lagrange multiplier for the determination of the source rates (Eq. (23)). 

At this point we will make another interesting observation regarding the online application of 
the proposed approach (Section |V^ during the network’s operation which is initially discussed in 
Section |Vj In order to obtain an online algorithm for the network control, i.e. during the network 
operation, we may consider that the network decisions are taken at Tt times when the channel is 
sampled, while also considering that = rj. Then, we should consider the optimal control values 
in the interval as “predicted” and the ones in the interval {s,Tb) as “corrections”. However, 

we should study under what conditions convergence is achieved (in practice) early enough (for 
small Tb) so that optimality with respect to the achieved value of P 2 is not affected. In Figs.|5(b)| 


5(c), it is shown that when increasing n, the time for convergence (according to the imposed 


criterion) of the proposed scheme is not significantly affected for time invariant utilities while 
it is affected in a concave manner for time varying utilities. As a result, if n is large enough, 
the decisions taken at times Tb will converge fast enough compared to the whole duration T. 
Therefore, the online application of the proposed approach during the network operation will be 
suboptimal only at the beginning barely affecting the optimal objective value of P 2 - 


VIII. Conclusions 

In this paper we presented, analyzed and evaluated a framework of NUM for performing 
routing, scheduling, congestion and power control under stochastic possibly non-stationary LTF 
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or STF wireless channels modeled by SDKs. The continuous stochastic non-stationary wireless 
channels along with the consideration of transient phenomena lead to a problem formulation 
that can also tackle non-convex and time-varying objective functions in an optimal way. Power 
control aims at increasing users’ experience allowing for higher source rates while also improving 
the energy efficiency. In the case of LTF, we prove that higher values of the diffusion coefficient 
of the power loss lead to higher optimal users’ utilities, a fact that cannot be captured by the 
conventional NUM problem’s formulation. Numerical results evaluate the latter along with the 
convergence properties of our proposed algorithms and the effect of diverse parameters on it. 
The efficiency of power control and the conditions under which an online implementation of the 
proposed approach is possible are also investigated. Finally, our proposed NUM-based framework 
may constitute a core for devising efficient cross-layer algorithms for the network operation that 
incorporate transient or non-stationary phenomena. 
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